Oslo
OSLO: One-Shot Label-Only Membership Inference Attacks
We introduce One-Shot Label-Only (OSLO) membership inference attacks (MIAs), which accurately infer a given sample's membership in a target model's training set with high precision using just a single query, where the target model only returns the predicted hard label. This is in contrast to state-of-the-art label-only attacks which require 6000 queries, yet get attack precisions lower than OSLO's.
Oslo University Hospital, University of Oslo, UiT The Arctic University of Norway andrekle@ifi.uio.no
Domain generalisation in computational histopathology is challenging because the images are substantially affected by differences among hospitals due to factors like fixation and staining of tissue and imaging equipment. We hypothesise that focusing on nuclei can improve the out-of-domain (OOD) generalisation in cancer detection. We propose a simple approach to improve OOD generalisation for cancer detection by focusing on nuclear morphology and organisation, as these are domain-invariant features critical in cancer detection.
OSLO: One-Shot Label-Only Membership Inference Attacks
We introduce One-Shot Label-Only (OSLO) membership inference attacks (MIAs), which accurately infer a given sample's membership in a target model's training set with high precision using just a single query, where the target model only returns the predicted hard label. This is in contrast to state-of-the-art label-only attacks which require \sim6000 queries, yet get attack precisions lower than OSLO's. The core idea is that a member sample exhibits more resistance to adversarial perturbations than a non-member. We compare OSLO against state-of-the-art label-only attacks and demonstrate that, despite requiring only one query, our method significantly outperforms previous attacks in terms of precision and true positive rate (TPR) under the same false positive rates (FPR). For example, compared to previous label-only MIAs, OSLO achieves a TPR that is at least 7 \times higher under a 1\% FPR and at least 22 \times higher under a 0.1\% FPR on CIFAR100 for a ResNet18 model.
The 200 Android vs. the 1,000 iPhone: How our digital divide keeps growing
On one screen, an urban professional in Oslo taps through ultra-secure banking apps, relies on an AI-powered personal assistant, and streams media seamlessly over high-speed 5G using their iPhone. On the other screen, a farmer in Malawi scrolls through a modest Android phone -- likely costing less than a week's wages -- just to read the news, check tomorrow's weather, and send WhatsApp messages over a patchy mobile connection. These very different experiences highlight the divide between the Global North and the Global South. These terms refer not only to geographic locations but also to the world's wealthiest and most industrialized regions -- such as Europe, North America, and parts of East Asia -- and economically developing nations across much of Africa, Latin America, South Asia, and Oceania. Technology symbolizes innovation, convenience, and seamless connectivity in the Global North.
OSLO: One-Shot Label-Only Membership Inference Attacks
Peng, Yuefeng, Roh, Jaechul, Maji, Subhransu, Houmansadr, Amir
We introduce One-Shot Label-Only (OSLO) membership inference attacks (MIAs), which accurately infer a given sample's membership in a target model's training set with high precision using just \emph{a single query}, where the target model only returns the predicted hard label. This is in contrast to state-of-the-art label-only attacks which require $\sim6000$ queries, yet get attack precisions lower than OSLO's. OSLO leverages transfer-based black-box adversarial attacks. The core idea is that a member sample exhibits more resistance to adversarial perturbations than a non-member. We compare OSLO against state-of-the-art label-only attacks and demonstrate that, despite requiring only one query, our method significantly outperforms previous attacks in terms of precision and true positive rate (TPR) under the same false positive rates (FPR). For example, compared to previous label-only MIAs, OSLO achieves a TPR that is 7$\times$ to 28$\times$ stronger under a 0.1\% FPR on CIFAR10 for a ResNet model. We evaluated multiple defense mechanisms against OSLO.
Uncertainty quantification in automated valuation models with locally weighted conformal prediction
Hjort, Anders, Hermansen, Gudmund Horn, Pensar, Johan, Williams, Jonathan P.
Non-parametric machine learning models, such as random forests and gradient boosted trees, are frequently used to estimate house prices due to their predictive accuracy, but such methods are often limited in their ability to quantify prediction uncertainty. Conformal Prediction (CP) is a model-agnostic framework for constructing confidence sets around machine learning prediction models with minimal assumptions. However, due to the spatial dependencies observed in house prices, direct application of CP leads to confidence sets that are not calibrated everywhere, i.e., too large of confidence sets in certain geographical regions and too small in others. We survey various approaches to adjust the CP confidence set to account for this and demonstrate their performance on a data set from the housing market in Oslo, Norway. Our findings indicate that calibrating the confidence sets on a \textit{locally weighted} version of the non-conformity scores makes the coverage more consistently calibrated in different geographical regions. We also perform a simulation study on synthetically generated sale prices to empirically explore the performance of CP on housing market data under idealized conditions with known data-generating mechanisms.
A 3D explainability framework to uncover learning patterns and crucial sub-regions in variable sulci recognition
Mamalakis, Michail, de Vareilles, Heloise, AI-Manea, Atheer, Mitchell, Samantha C., Arartz, Ingrid, Morch-Johnsen, Lynn Egeland, Garrison, Jane, Simons, Jon, Lio, Pietro, Suckling, John, Murray, Graham
A B S T R A C T Precisely identifying sulcal features in brain MRI is made challenging by the variability of brain folding. This research introduces an innovative 3D explainability frame-work that validates outputs from deep learning networks in their ability to detect the paracin-gulate sulcus, an anatomical feature that may or may not be present on the frontal medial surface of the human brain. This study trained and tested two networks, amalgamating local explainability techniques GradCam and SHAP with a dimensionality reduction method. The explainability framework provided both localized and global explanations, along with accuracy of classification results, revealing pertinent sub-regions contributing to the decision process through a post-fusion transformation of explanatory and statistical features. Leveraging the TOP-OSLO dataset of MRI acquired from patients with schizophrenia, greater accuracies of paracingulate sulcus detection (presence or absence) were found in the left compared to right hemispheres with distinct, but extensive sub-regions contributing to each classification outcome. The study also inadvertently highlighted the critical role of an unbiased annotation protocol in maintaining network performance fairness. Our proposed method not only o ff ers automated, impartial annotations of a variable sulcus but also provides insights into the broader anatomical variations associated with its presence throughout the brain. The adoption of this methodology holds promise for instigating further explorations and inquiries in the field of neuroscience.1. Introduction While the folding of the primary sulci of the human brain, formed during gestation, is broadly stable across individuals, the secondary sulci which continue to develop post-natally are unique to each individual. Inter-individual variability poses a significant challenge for the detection and accurately annotation of sulcal features from MRI of the brain. Undertaking this task manually is time-consuming with outcomes that depend on the rater. This prevents the e fficient leveraging of the large, open-access MRI databases that are available. While primary sulci can be very accurately detected with automated methods, secondary sulci pose a more di fficult computational problem due to their higher variability in shape and indeed presence or absense [3]. A successful automated method would facilitate investigations of brain folding variation, representative of events occurring during a critical developmental period. Furthermore, generalized and unbiased annotations would make tractable large-scale studies of cognitive and behavioral development, and the emergence of mental and neurological disorders with high levels of statistical power. The folding of the brain has been linked to brain function, and some specific folding patterns have been related to susceptibility to neurological adversities [20].
Open-Set Likelihood Maximization for Few-Shot Learning
Boudiaf, Malik, Bennequin, Etienne, Tami, Myriam, Toubhans, Antoine, Piantanida, Pablo, Hudelot, Céline, Ayed, Ismail Ben
We tackle the Few-Shot Open-Set Recognition (FSOSR) problem, i.e. classifying instances among a set of classes for which we only have a few labeled samples, while simultaneously detecting instances that do not belong to any known class. We explore the popular transductive setting, which leverages the unlabelled query instances at inference. Motivated by the observation that existing transductive methods perform poorly in open-set scenarios, we propose a generalization of the maximum likelihood principle, in which latent scores down-weighing the influence of potential outliers are introduced alongside the usual parametric model. Our formulation embeds supervision constraints from the support set and additional penalties discouraging overconfident predictions on the query set. We proceed with a block-coordinate descent, with the latent scores and parametric model co-optimized alternately, thereby benefiting from each other. We call our resulting formulation \textit{Open-Set Likelihood Optimization} (OSLO). OSLO is interpretable and fully modular; it can be applied on top of any pre-trained model seamlessly. Through extensive experiments, we show that our method surpasses existing inductive and transductive methods on both aspects of open-set recognition, namely inlier classification and outlier detection.
Students use AI technology to find new brain tumor therapy targets -- with a goal of fighting disease faster
Thomas Fuchs, the Dean of Artificial Intelligence and Human Health at Mount Sinai in NYC, said AI will be needed to retain the standard of care in the U.S. Glioblastoma is one of the deadliest types of brain cancer, with the average patient living only eight months after diagnosis, according to the National Brain Tumor Society, a nonprofit. Two ambitious high school students -- Andrea Olsen, 18, from Oslo, Norway, and Zachary Harpaz, 16, from Fort Lauderdale, Florida -- are looking to change that. The teens partnered with Insilico Medicine, a Hong Kong-based medical technology company, to identify three new target genes linked to glioblastoma and aging. They used Insilico's artificial intelligence platform, PandaOmics, to make the discovery -- and now, they plan to continue researching ways to fight the disease with new drugs. Their findings about target genes were published on April 26 in Aging, a peer-reviewed biomedical academic journal.
Senior Data Scientist - Oslo (Fylke), Østlandet (NO) job with Barrington James
This innovative biotechnology company powered by AI, wishes to grow by hiring a senior data scientist. They are the proprietors of a company that uses specialised machine learning algorithms to forecast immunogenic antigens for personalised cancer immunotherapy and infectious diseases like COVID-19. Knowing Norwegian is not required. Following your application Rebecca Jones, a specialist recruiter, will discuss the opportunity in detail. She will be more than happy to answer any questions relating to the industry and the potential for your career growth.